Using Automatic Item Generation to Address Item Demands for CAT

نویسندگان

  • Hollis Lai
  • Cecilia Alves
  • Mark J. Gierl
چکیده

Item writing is a craft that is both resource intensive and time consuming. In order to minimize item exposure, computer adaptive testing requires a large number of test items for administration. As test development become more complex, demand for the quantity and quality of items far exceeds the capacity of item writers writing in the current fashion. To address the demand for items to be created in a precise and high-volume fashion, this study suggests the use of automatic item generation (AIG) as a solution to current test development practices. The purpose of this paper is to explore development preferences of item models under AIG, using an item model taxonomy. After adequate training, 34 item models were created and categorized under the taxonomy, and generated 64,280 items. Implications from the study and potential challenges for applying AIG are discussed.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Establishing Item Uniqueness for Automatic Item Generation

Objective The growing popularity of Automatic Item Generation (AIG) can be attributed to the increasing demand for the production of large pools of operational test items. AIG is an algorithmic way of generating assessment tasks which combines cognitive theories, psychometric practices and computer technologies. The outcome of this algorithmic transcriptions of assessment task is 1986). The ite...

متن کامل

Multidimensional Computerized Adaptive Testing in Recovering Reading and Mathematics Abilities

Under a MIRT CAT’s (multidimensional computerized adaptive testing) testing scenario, an ability estimate in one dimension will provide clues for subsequently seeking a solution in other dimensions. This feature may enhance the efficiency of MIRT CAT’s item selection as well as its scoring algorithms compared with its counterpart, unidimensional CAT (UCAT). The shadow test approach ( van der Li...

متن کامل

Automatic Item Text Generation in Educational Assessment

We present an automatic text generation system (ATG) developed for the generation of natural language text for automatically produced test items. This ATG has been developed to work with an automatic item generation system for analytical reasoning items for use in tests with high-stakes outcomes (such as college admissions decisions). As such, the development and implementation of this ATG is c...

متن کامل

Controlling item difficulty for automatic vocabulary question generation

The present study investigates the best factor for controlling the item difficulty of multiple-choice English vocabulary questions generated by an automatic question generation system. Three factors are considered for controlling item difficulty: (1) reading passage difficulty, (2) semantic similarity between the correct answer and distractors, and (3) the distractor word difficulty level. An e...

متن کامل

Adaptive evaluation in an E-Learning System Architecture

This paper presents the result of the integration of an automatic evaluation module in ELSA, a complete, user-friendly and easy-to-use e-learning environment. Although this new module is already operative, it is in the marketing phase to be included both in BOGA, the commercial version of ELSA to be used on Internet, and in Hezinet, the version nowadays employed as a complementary tool in class...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2010